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Preface 


This  report  addresses  the  implementation  of  a 
pseudo-olosed  loop  control  law  to  a spacecraft  intercept 
problem  formulated  as  a differential  game.  Although  it 
is  recognized  that  a solution  to  the  two-point  boundary 
value  problem  is  required  to  initiate  this  control  law, 
methods  to  obtain  solutions  are  not  discussed  in  this 
report.  My  purpose  is  to  validate  the  control  law  for 
a more  realistic  problem  than  has  been  previously  demon- 
strated. 

I wish  to  express  my  sincere  appreciation  to  Prof. 
Gerald  M.  Anderson  of  the  Air  Force  Institute  of  Technology 
for  his  advice  and  assistance  in  this  effort. 


Gary  D.  Bohn 
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Abstract 

A near-optimal  closed  loop  control  law  for  zero-sum 
perfect  information  differential  games  is  tested  on  a free 
final  time,  minimax  range,  pursuit-evasion  game  between  two 
constant  thrust  spacecraft. 

The  control  law  is  based  on  a periodic  first  order 
update  to  the  costate  vector.  This  costate  correction  is 
generated  from  the  state  error  from  a reference  TPBVP 
solution.  Two  nearly  equivalent  methods  to  obtain  the 
relationship  between  the  costate  correction  and  the  state 
error  are  tested.  Three  coplanar  trajectories  and  two 
r.on-coplanar  trajectories  are  tested  using  various  vehicle 
characteristics. 

The  control  law  is  shown  to  provide  the  pursuer  an 
effective  means  to  take  advantage  of  non~optimal  play  by 
his  opponent;  thereby  reducing  the  final  range  below  the 
original  TPBVP  solution. 

Plots  comparing  the  TPBVP  solutions  and  the  trajec- 
tories resulting  from  application  of  the  control  law  against 
several  non-optimal  evaders  are  presented. 
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APPLICATION  OP  A NEAR-OPTIMAL  CLOSED  LOOP 
CONTROL  LAW  TO  A PURSUIT-EVASION 


GAME  BETWEEN  TWO  SPACECRAFT 


I.  Introduction 


Background 


The  theory  of  zero-sum  perfect  Information  differential 
games  has  been  successfully  applied  to  a large  number  of 
problems  in  which  two  players  have  diametrically  opposed 
goals.  One  serious  drawback  to  the  application  of  differ- 
ential games,  however,  is  that  closed  loop  control  laws,  by 
which  one  player  could  take  advantage  of  non-optimal  play 
by  his  opponent,  have  not  been  developed  for  realistic, 
non-linear  problems.  To  date,  closed  loop  control  laws 
have  been  developed  only  for  linear -quadratic  problems 
(Ref  3)  and  for  simple  problems  of  low  state  dimension 
(Ref  5). 

Anderson  (Refs  1,2)  has  proposed  two  methods  to  gen- 
erate near-optimal  dosed  loop  solutions  to  non-linear 
differential  games.  However,  he  has  applied  these  methods 
only  to  simple  problems  with  low  state  dimension.  The  suc- 
cess of  these  methods  on  realistic  non-linear  problems  with 
large  state  dimension  has  yet  to  be  demonstrated. 


Statement  of  the  Problem 

So ope.  This  study  applies  these  two  near-optimal 
dosed  loop  control  laws  to  a free  final  time,  minimax  range 
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pursuit-evasion  game  between  two  spacecraft.  Both  coplanar 
and  three  dimensional  models  are  used. 

Assumptions . Both  vehicles  thrust  continuously  with 
constant  thrust,  the  thrust  of  both  vehicles  being  the  same. 
If  either  vehicle  ceased  thrusting,  the  problem  becomes  a 
one  player  game,  the  advantage  passing  to  the  player  which 
is  still  thrusting.  A simple  intercept  or  avoldanoe  prob- 
lem results. 

Two-body  dynamics  with  an  inverse  square  gravitational 
field  are  used.  The  central  attracting  body  is  considered 
to  be  a homogeneous  sphere,  and  the  vehicles  are  considered 
to  be  point  masses.  All  perturbative  forces,  other  than 
thrust,  are  neglected. 

The  payoff  is  the  separation  between  the  vehicles  at 
final  time.  ‘The  pursuer's  goal  is  to  minimize  final  range; 
the  evader's  goal  to  maximize  this  same  quantity.  Each 
player  has  perfect  Information  on  the  current  state  of  the 
system  and  the  performance  capabilities  of  his  opponent. 

Each  controls  his  thrust  direction  to  achieve  his  desired 
goal. 

The  mass  of  each  vehicle  decreases  at  a constant  rate 
proportional  to  the  vehicles'  thrust.  Minimum  range  is 
assumed  to  occur  prior  to  either  vehicle  exhausting  its 
available  fuel. 

There  are  no  barriers  or  ill-defined  surfaces.  That  is 
it  is  assumed  that  the  solution  in  the  small  is  valid. 

Approach.  The  two-point  boundary  value  problem  (TPBVP) 

2 


describing  the  coplanar  free  final  time,  minimax  range 
differential  game  Kill  be  formulated  and  solved,  using  a 
variety  of  vehicle  thrust-to-weight  ratios  and  different 
final  ranges. 

Using  a TPBVP  solution  as  a nominal  trajectory,  both 
oontrol  laws  will  be  extensively  tested,  using  various  non- 
optlmal  controls  for  the  evader,  in  order  to  demonstrate 
the  equivalence  of  the  two  methods.  In  addition,  the 
effect  of  different  sampling  intervals  will  also  be  in- 
vestigated. Each  oontrol  law  will  then  be  tested  on  other 
nominal  trajectories,  allowing  the  evader  to  use  several 
non-optlmal  controls. 

Pinally,  the  model  will  be  expanded  to  allow  both 
players  to  thrust  out  of  the  plane  of  their  trajectories, 
and  to  allow  a non-coplanar  intercept.  Two  nominal 
trajectories  will  be  investigated  here;  the  first,  in  which 
both  vehicles  are  initially  moving  in  the  same  reference 
plane,  and  the  last,  in  which  the  pursuer  is  initially  out 
of  the  reference  plane  of  the  evader. 
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where  the  thrust  angle  a Is  measured  from  the  local  hori- 
zontal as  shown  in  Pig.  1.  Additionally,  since  the  thrust 
is  oonstant,  the  mass  is  allowed  to  vary  by 


m «•  m0  + m t (3) 


Pig.  1.  Coplanar  Orbital  Geometry. 


Rewriting  Eqs.  (1)  and  (2)  in  terms  of  the  radial  and 


transverse  velocities,  Vr  and  V^,  gives 


Vr-  * - -4 
r rl 


Vr  Vi 


, Fsifia 

— + 

r1  m 

F cos  oc 

m 


where 


Vr=  r 
V(s  = r0 


It  is  desirable  to  normalize  the  equations  of  motion 
so  that  all  parameters  are  the  same  order  of  magnitude. 
This  is  done  by  defining  the  state  variables 


Xj=  0 


where  rQ  is  the  radius  of  a circular  orbit  at  the  surface 
of  the  earth,  and  VQ  is  the  transverse  velocity  of  that 
circular  orbit. 


The  non-dimensional  time  unit  is  introduced 


Vot 


(13) 


The  time  derivatives  must  be  converted  to  tau  derivatives 

by 


do  _ djj  fd t\  _ /J% 
df  “ dt  IdT I IVJ 


d_[_) 

dt 


(i4) 


The  vehicle  mass  and  mass  flow  rate  are  also  normalized 
relative  to  the  initial  mass  so  that 


ra  - | + mT 
To  F 


m * - 


Vem0isPg£ 


(15) 


(16) 


Using  Eqs.  (9)  thru  (12)  and  Eq.  (14),  the  normalized 

1 


state  differential  equations  become 

x:  = xt 

« _ ± + 

Ai  X,  X,1 


C sin  ct 

m 


/ _ X<V 

x, 


X*  * 


/ _ Xz  X4  C CoSa 

~ X,  m 


(17) 

(18) 

(19) 

(20) 


ATau  derivatives  will  be  indicated  by  a prime  (')  to  avoid 
confusion  with  time  derivatives. 
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r»F 
v»  m, 


These  equations  of  motion  apply  to  both  vehicles, 


Three  Dimensional  Equations  of  Notion 

If  the  pursuer  and  the  evader  are  not  initially  in  the 
same  plane,  or  if  the  thrust  direction  is  not  restricted  to 
lie  in  the  orbital  plane  of  the  vehiole,  then  three  dimen- 
sional equations  of  motion  must  be  used. 

Using  the  spherical  coordinate  system  indicated  in 
Pig.  2,  the  three  dimensional  equations  of  motion  for  two 


body  dynamics  are 


r-r6*-rj»‘sirfe.  - £ H.E225.' 

r2-  m 


re  +2r6  -rfr'cosBsmd  = Fcos^cosa»- 
r#smG  ♦ 2r90cos6+2r0sm6  = 


where  the  thrust  angles  CX|  and  are  measured  as  depicted 

if  Pig.  3. 

If  the  vehicles  lie  in  the  same  reference  plane  (0=  tr/2 ) , 
and  the  thrust  direction  is  restricted  to  lie  in  the  plane  of 
the  orbit,  these  equations  reduce  to  the  coplanar  equations 
of  motion,  Eqs.  (1)  and  (2). 


Fig.  2.  Three  Dimensional  Orbital 
Reference  Frame. 


As  in  the  case  of  the  coplanar  equations  of  motion, 
Eqs.  (22)  thru  (24)  are  rewritten  using  the  radial  velocity 
the  theta-transverse  velocity,  and  the  phi-transverse 
velocity  as  variables. 


the  state  differential  equations  are 


XI  = X* 

(37) 

v2 

Vfc  si  n1  X3  t Csm«t 

x,  X,  + m 

(38) 

yl  _ X* 

(39) 

y- . XtX, 
*'■  X, 

+ |^emXJ+  Cco“>“s“ 

(4o) 

>#!x- 

II 

(41) 

y/ XjXfc 

x'-~  T 

2y+X4CosX3  ( C sma,  cosoci 
X»  sm  X3  m Sin  X3 

(42) 

where  C is  defined  by  Eq.  (21)  and  the  mass  varies  by 
Eqs.  (15)  and  (16). 

Again,  the  motion  of  eaoh  vehicle  is  governed  by  these 


equations 


III.  Differential  Game  Formulation 

The  pursuit-evasion  differential  game  presented  here 
is  free-time,  with  final  range  as  the  payoff.  The  solution 
to  the  differential  game  is  required  prior  to  initiating  the 
control  law.  The  formulation  follows  that  of  Bryson  and 
Ho  (Ref.  3). 


Coplanar  Game 

Both  the  pursuer  (p)  and  the  evader  (E)  have  identical 
state  equations  given  by  Eqs.  (17)  thru  (20).  Thus 


(43) 

(44) 

(45) 


Cp  cos>  U. 

+ 

mP 


X/t  - Xze 


(46) 

(47) 


Xie [_  + Ce  s>n  V (48) 

Xie  Xie  me 


. - 0 

X*e 

%' 

II 

(49) 

Xte 

Xie  X^e 

Ce  cos  V 

4*  — ■ 

(50) 

X,e 

me 

11 


..  w: r..  


where  u and  v are  the  thrust  angles  for  the  pursuer  and 
evader,  respectively.  The  mass  of  each  vehicle  varies 
according  to  Eqs.  (15)  end  (l6) 

The  desired  result  for  any  intercept  problem  is  to 
hit  the  target  vehicle,  or  at  least  to  get  as  close  as 
possible,  at  which  time  the  warhead  is  detonated.  The 
target  vehicle  should  attempt  to  escape  the  interceptor; 
that  is,  to  maximize  the  range  at  closest  approach.  Thus, 
the  final  range  is  a natural  choice  for  the  payoff  for  this 
game.  The  distance  between  the  two  players  is  given  by  the 
law  of  cosines  (Fig.  4).  For  simplicity,  the  square  of  the 
final  range  is  used,  scaled  by  a factor  of  one -half. 

J “ 2 J^‘f  + Xip  Xitf  COS  (Xap"  Xaejj  (51) 


Fig.  4.  Coplanar  Range 
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Since  there  is  no  path  cost,  the  Hamiltonian  (H)  is 
formed  by  adjoining  the  costates  to  the  state  equations. 


H-  Apfp  + Ag-fe 


H = Ai Px2p  4 A2p  + 

♦*-®*mV* 

■+  A, 4 X2e  4 ^ze  j~  - + 

\/\ie  Xte 

♦M%)  * M- ^ 


Cpsm  u\ 

HTp  / 
Cp  cos  u \ 

mp  / 

Ce  smV  \ 

me  / 

C e C.OS  V \ 
me  / 


(52) 


The  costate  differential  equations  are  given  by 


A'T=  -Hx  = g(x,A/r) 


which  yields 


^ _ 2Aa?  Xap  X<p  Ajp  X.pXh> 


•r 


XJ 


Xfp 


Xt> 


XA 


AiP  - -A„  + 

A|p 

K = o . 


V _ _ ^ X^p  ^ Aap  Xzp 

'ty*  V v * V 


Mp 


MP 


'*P 
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(53) 


(54) 


(55) 


(56) 

(57) 


. -A  > 't  -wr. 


W*WWW»W^J»M«'',-,^!W',^>!'.,?fi"l  TZ*PBF™VW'  •■■• J ■»■*  - .w^™ictiwi»ii,!i  rrr’<-nwxn 


AU  - 


A+e  = - 


: X»g  _ 2 A?e 

j A^e  X4e  A^e  Xze  X*g 

(58) 

i y 3 

ie  Aie 

X,le  Xfc. 

i2€  = ~ Aie  + 

A4e  A4e 
Xje 

(59) 

Aje 

= 0 

(60) 

2 X/ie 

Aje  A<e  X2e 

(61) 

X\e 

X\e  X- 

The  expressions  for  the  pursuer’s  optimal  control 
angle  are  found  by  minimizing  the  Hamiltonian  with  respect 
to  u: 


1 1 A^p  Cos  lx  A^p  <wp  Sl  n tx  ^ 

u ^ mP 


m, 


(62) 


which  yields 


tan  u-  v2 
/W 


The  sufficiency  condition 


1 1 

Huu 


_ X2pCp  sin  u A4pCpcos  u v q 
trip  rrip  u 


requires  that 


sin  U.  - - 


C05  IX  - - 


Aif 


\/  AJp 4 


VaJp  + Ai 


(63) 


(64) 


(65) 

(66) 


w 'VW* 7 w*  mg  >;mw*  ■»  • hh '!'  •»'  <4t»VJ 


F %Tgjtqwf*yff* v^Pfy1 w i»sh-  - w»  pjys^^iTOwy^T 


The  evader’s  optimal  control  is  found  by  maximizing 
the  Hamiltonian  with  respect  to  v.  An  expression  similar 
to  Eq.  (63)  results,  except  that  the  sufficiency  condition 
(T?vv  < 0)  requires  that 


Sin  V - 

Aze 

(67) 

N/Xze  + AJe 

cos  V - 

(68) 

The  transversality  conditions  give  the  value  of  the 
oostates  at  final  time 


XM  ■ m - g). 

(69) 

A»P  (l^f)  = (XiF-Xie  COS  (Xap-  X^e) 

(70) 

Krfah  0 

(7D 

^3p(^?)=  (^'P  (Xap  ” Xae) 

(72) 

VK)'  ^ 

(73) 

he  (if)  ~ [x*fi  _ Xsp  cos  (X?.p  - Xae)  j 

(74) 

A-Z€  ("If)  * 0 

(75) 

A3e(lf )=  (“  xip  Xi£ Sin  (fop-  Xse)  )lf 

(76) 

A4e(^)  ' 0 

(77) 

An  additional  requirement  for  the  free  time  problem  is 
that  the  Hamiltonian  be  zero  at  final  time.  Substituting 
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the  expressions  ( 70)  thru  (77)  into  Eq.  (52)  at  final  time 
gives 


i , 


0=  [X,  Xip  + Xie  Xie 
" (Xzp  X\e  + XipXze)  Cos  (Vjp"  X%e) 

+ ()4fXte~  XipX^e)s\n  (Xjp- 

This  is  the  same  condition  as  requiring  the  range- 
squared  rate  to  be  zero  at  closest  approach.  Differentiating 
Eq.  (51)  and  setting  the  result  equal  to  zero  gives 

0 = XlpX;p  + X,e  X»e 

- (Xtp  Xie  +■  Xip  Xie)  cos^p-X^e) 

+ XipXie  (X^p  - )^e)  (Xjp- X^e)  (79) 

Substituting  Eqs.  (43)  thru  (50)  gives 

0=  XipXip  + X^  Xze 

*"  (Xsp  Xie  + XipXie)  cos  (Xjp-Xse) 

+ - Xip  X*e)  tm  (ft?-**.)  <80> 

which,  when  evaluated  at  final  time,  is  the  same  as  Eq.  (78). 

The  two-point  boundary  value  problem  (TPBVP)  for  the 
coplanar  model  is  given  by  Eqs.  (43)<J;hru  (50)  , (5*0  -Ahru 
(6l),  (70)  .thru  (78),  plus  the  initial  values  of  the  states. 

Three  Dimensional  Game 

As  in  the  coplanar  game,  the  pursuer  and  evader  have 
the  same  state  equations. 
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X»p  = Xip 

y'  w X$p  XtpSlnl)(3p  I 
Aap  - rr~  ■+  — - — + 

Xip  Xip  X,p 


Cp  sin  Uz 


Y'  - X*p 

Xap  r 


up 


x» 


w i Xip  Xtp 

% V 

Alp 


Xfrp  S1K  Xsp  COS  X3P  Cp  Cos  u,  cos  UL 

Xip  mP 

Y ' _ X*p 

A5P  - 

X»P 

2 X^p  cos  Xy  Cp  stnu,  cq3U2 

XipSinfep  %sinX3p 

Xie  5:5  Xze 


x^=  + Xue  |_  + Ce  sinVj 

Xie  Xie  VS.  kyu 


Xfc  me 


Xi£ 


«e  * ~ 
Aie 


/ _ __  Xze  X4e 


Xle  = 


X,e 


Xfae  ^10X3^  cgsXg£  Ce  Cos  V,  cosY^ 
X»e  me 


Xse  = 


Xte 

X* 


' Hi 

J4lt=  - — X^e  2.  X^e.  XU  c°s  Ce  sin  V!  cosVz. 

X»e  Xie  ^\n  Xge  me  Sin  X3e 


(81) 

(82) 

(83) 

(84) 

(85) 

(86) 

(8  7) 
(88) 

(89) 

(90) 

(9D 

(92) 
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where  u^,  Ug,  v.p  and  Vg  are  the  thrust  angles  for  the 
pursuer  and  evader,  respectively. 

Again,  the  payoff  is  one-half  the  square  of  the  final 
range  between  the  two  players.  However,  a straight-forward 
application  of  the  law  of  cosines  oannot  be  used  in  this 
case,  since,  in  general,  the  plane  defined  by  the  position 
vectors  does  not  lie  in  the  0-  or  ©-plane  (Pig.  5).  Recog- 
nizing that  the  law  of  cosines  may  be  written  as 

D*=  Tp  + r<?  - 2(?yfe)  (93) 

reveals  the  clue  to  determining  the  range  between  the  vehicles. 


Fig.  5 • Three  Dimensional  Range 


By  reference  to  Pig.  2,  it  can  be  seen  that  the  com- 
ponents of  the  position  vector  in  the  inertial  reference 
frame  (ex,  ey,  ez)  are 


Performing  the  dot  product  in  Eq.  (93) ♦ the  payoff 


beoomes 


2 X\e  Xt,e  Cos  Ce  sin  Vi  oosV;\ 

Xte^inXie  rvufcmXse  ' 

The  costate  differential  equations  are 

XT=  -Hx-g(x,A,T) 

^'P  * + X^s,lr,l)4p  - A^p  jXap  X4p 

- Xkp  cos  Xlp  SI  n Xspj  - | Xjp  XP  + 2 Xtp  XiP  cot  Xip) 

+ Ajp  X*f  + Xep  Xtp] 


XL  = - A,,  + + X«f  Xy 

Xip  Xip 


\if  Xup  sin , 


A1  = - ^Vsln2^  _ *4p  xip  60S  2 Kip 

Xip  Xip 

- 2A>,pXjpXq>  Cp  Afr  cos  X^p 

Xip  sin  Xjp  pripSin3Xip  [Afp^-Afp  + (Afcf/frmX3p)^] 

_ Ay  + A^Xap  + 2VXtptosfep 


Xipsm  Xip 


A L = 0 


^ = ‘ ^[ZAapXbpSi^Xjp  -V  A^Xi?  Sin2x*p 

+\sP  - _ V y ] 

P *inXaP 


(103) 
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Applying  the  optimality  conditions 

HU|  a 0=  - + AhfCptt&UtOOSU,  (u0) 

"V  mp  6in  Xsp 

Hut=0=  — (A2Pcosu<, -X^cdsu smu , - — ->1J'%lnUl)  (ill) 

"V  smX3P  / 


from  which 


■tan  u,  = 


A44.  smVsp 


tan  14=  Atf (\«P  cosu,  + 

Mm  X3p  / 


(112) 


(113) 


The  sufficiency  conditions  require  the  matrix  be  positive 
definite 


Prom  Pig.  3t 


(114) 


TT  IT 

- 2 < Ui  < 2 


(115) 


on  -f-Vio £ 


COS  (4  » 0 


Thus,  from  Eqs.  (110)  and  (114) 


COS  U,  = 


Sin  av  = 


- Av? 


^ + (Atp/sinXsp)1 


~ A.p/sin  Xap 

Afp  (Afep/sm  Xsp}1 


(116) 


(117) 
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In  addition. 


Hf^u^  - X?f  Sin  U2  - Cos  (J*^  Co*  U,  + ~^"j  >0  (119) 


Using  Eqs.  (113)  and  (114),  the  requirement  for  the  in- 
equality in  Eq.  (119)  to  hold  is  that 


“ Azp 

VXzp  + Alp  *t  ()y,p  /sin  Ksp)1 


(120) 


It  follows  that 


COS  Uz  = 


M4>  +(Afep /sin  X*p)z 


Alj»  + Atffi*  + (a^p  A>in  Xjp) 


(121) 


An  additional  requirement  for  the  matrix  Huu  to  he 
positive  definite  is  that 

Det  Huu  > 0 


Using  Eqs.  (117),  (118)  and  (120),  it  can  be  easily  shown 
that 

Hu,Uz  - HuiUv=  0 (122) 


Thus,  the  matrix  is  positive  definite. 


Following  the  same  procedure  to  find  the  evader's 
control 


ll  X|e  Ce SinVjCos \fc  \,e  Ce  cotViCosV^ 

HVir  U-  7, 


(123) 


me 


0 = — | Xie^^Vi  ~ A^eCosVj'SinV^  - 


Xtesmv^  <5inVii 


smX3e 


(124) 
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tqn  V,  = 


Ac,e  /sm  tae 


(125) 


tan  vz  = A^fA^  cos  y,  + (126) 

x fcm  Xse  / 

Since  the  evader  is  maximizing  the  payoff,  the  suf- 
ficiency conditions  require  that  Hvv  be  negative  definite. 


This  requires 


Hv,v,  = cosvi(-A4ecobV,-  ~^)  < 0 


As  with  u2,  v2  is  restricted  to 

tr  , , tt 

“2  <V“‘2 


so  that 


and,  from  Eq.  (127) 


COS  Vz  ^ 0 


(12?) 


COS  V,  = rff=  TTTTu 
VA-t*  + ( A(^/ si  n X3e) 


£>in  Vi  * 


Ate/ Stn  Xgg, 
/^(A  j,e/s»n  Xje)1 


Again,  using  Eqs,  (130)  and  (131)*  it  can  be  shown 


that 


Hv/,Vi=  Hv^i  = 0 
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IT*'*  -3*v*%  1>  > • 


so  that,  for  H^  to  be  negative  definite  requires 

Hv^=  -AMSmV2  + COSV^-AwCOe.V,-  -'“ ) < 0 


Using  Eqs.  (125)  and  (12?) 


s/n  V2  = 


cos  V?  = 


Ve 


VA^e  + Aj^  + (Ate/siiXsef 

fA^t  + (X^e/fetn  Xsej1" 
+ + (Ate  Xac) 


(133) 


(134) 

(135) 


The  values  of  the  costates  at  final  time  are  given  by 
the  transversal ity  conditions 


( *'«•  mMtX 

(136) 

AiP(l^)  - |XiP  - XiefsmXapsmXae  cos(Xs>P-Xse) 

■V  Cos  X3p  cos  Xael  1 

(137) 

Azp  (Tf)  - 0 

(138) 

^sp(lf)“  X*P  Xie  c©s Xsp  siw  Xje  Cos(Xsp--X5e.) 

“■  s>ir\X3p  cos  XizJ^ 

(139) 

Vp(if)=  o 

(140) 

Asp (5|)=  (X)P  Xe  sinX3p  smXse  sin(Xsp-  Xse) 

(141) 

o 

(142) 

Aie(t ^)-  (Xie  ~ Xip^inX3psinX3e  cos(Xsp-X5d) 

f-cosXjpcosXselL 

(143) 

25 


X^f'tf]-  0 

_ |”  K|g,  Xip  cosXscsiftXjp  cos(Xsp-  Xsej 
- sin  Xs«  cos  X*pJ^ 

Ase(f.p)  = |~XipX\e.  sinXspsmXge  &m(Xsp-Xse)  j. 
Ate  (if)  ~ 0 


(144) 

(145) 

(146) 

(147) 

(148) 


As  before,  the  Hamiltonian  must  be  zero  at  final  time. 
Using  Eq.  (96)  and  Eqs.  (137)  thru  (148) 

H ffy) = 0 = |Xip  Xzp  •+  Xie  Xze 

(X»e  Xip  + Xip  Xzc)  [sm  Xip  sin  Xje  cos  (Xsp  - Xse) 
cos  X3p  cosX^e]  — XtfXie  £cosX3p9n  'tie 
~ ^inX%pCosX3cJ'*'(XtpX}e”Xip)(w.)sinXjpsir]X3e  sinjXsp-Xsej 
- Xip  X4e  [sin  X?p  cos  )^g  cos(Xsp~X5e)“  cos  X*p*>in  Xa^j  j ^ 


(149) 


As  in  the  coplanar  case,  the  stopping  condition  that 
the  range-squared  rate  be  zero  at  closest  approach  gives 
the  same  expression  as  Eq.  (149). 

Por  the  three  dimensional  game,  the  TPBVP  is  given  by 
Eqs.  (81)  thru  (92),  (98)  thru  (109),  (137)  thru  (149), 
and  the  initial  values  of  the  states. 
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IV.  Pseudo~Closed  Loop  Control  Law 


The  pseudo-olosed  loop  control  law  used  in  this  report 
is  based  on  a periodic  first  order  update  to  ;he  oostate 
vector.  At  each  sampling  time,  this  update  j/<  generated 
from  the  difference  between  the  actual  states  and  the 
states  of  a reference  trajectory.  The  reference  trajectory 
assumes  optimal  play  by  both  players  from  the  sampling  time 
to  final  time. 

For  the  error  in  the  state  vector  at  time  t^  given  by 

8x(t*)=  x(t*)-  xrrf  (a) 

the  costate  vector  is  updated  by 

M*k)“  (t*)  + SAW 

The  correction  to  the  oostate  vector  is  produced  by 

SA(t<)=  CSx(tK)  (152) 

where  C is  an  n x n "control*  matrix. 

Two  nearly  equivalent  methods  have  been  proposed  to 
generate  this  C matrix  (Refs.  1,2). 


(150) 

(15D 


Backward  Sweep  Method  (Ref.  1) 

Assuming  free  final  time  and  no  oontrol  constraints, 
the  linearized  TPBVP  is  (Ref.  3) 


$x  * fx8x +-f\SA  ; Sx(to)  given  (153) 
8 A - 9x6x-vgA8X  (154) 
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SA(tf) 

~ 

(0«*  + »T</'w) 

O-l 

"Sxfo)’ 

0 

Ift 

0 

I/'t 

.0 

Zh 

at 

ti 

• 

dtf. 

(155) 

(156) 

(157) 


where  l//"  is  the  terminal  constraint,  V is  a Lagrange  multplier 
associated  with  V^*  and 


-a  4 (t  + l) 


(158) 


The  solution  to  this  linearized  TPBVP  is  assumed  to 
have  the  form 


S\ 

— 

0 

0. 

- 

n i 

n 

RT(t) 

m^t) 


Rlt) 

Q(t) 

nr(t) 


m(t) 

net) 

alt) 


6x 

dv 

dtf 


(159) 

(160) 

(161) 


n,  and  a are  scalars. 

For  the  problem  considered  in  this  report,  there  is  no 
so  that  Eqs.  (155)  thru  (157)  reduce  to 

(162) 

(163) 


- 

sw 

al 

8x(t()’ 

_o 

a* 

at. 

dfy 

and  the  assumed  form  of  the  solution  is 


~S\ 

— 

• 

5 

m 

6x~ 

0_ 

mT 

a 

dtf 

(164) 

(165) 
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(166) 


For  Eq.  ( 1 63 ) can  be  solved  for  dt 


f* 


This  expression  Is  substituted  into  Eq.  (162)  to  yield 

(0**  - ”*)  Sx(tf)  (167) 

Eqs.  (164)  and  (165)  become 

SA=  (S-^T)SX  = S6x  we) 

Thus  S Is  the  desired  control  matrix. 

• * 

Differentiating  Eq.  (168)  and  substituting  for  8x»  8X» 
and  sx  yields 

0=§*S-fx  + §f>S-9xS-9*  (169) 

with  the  condition  at  final  time 


(170) 


Between  sampling  times,  Eqs.  (169)  and  (170)  are  used  to 
generate  3 and  Eq.  (168)  is  used  to  obtain  the  costate  cor- 
rection, 8X  (t’jJ  1 as  a function  of  the  state  error, 
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Substituting  Eq. . { 172)  for  8A  (t^)  gives 


8x(t)=  X 8x(tf). 

8X(t)=  A 8x(tf) 

where 

^ s ^(t7tf)  A 

As  &*(*,  tf)  + $M(t,tf.) A 
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(175) 

(176) 

(177) 

(178) 
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Solving  Eq.  (1?5)  for  &X  (tr)  and  substituting  into  Eq.  (1?6) 


SA(tJ  » (AX  )t^  Sx(t^) 


(179) 


This  provides  the  relationship  between  Sx  and  sx  at 
time  t^,  and  the  control  matrix  is  AT'. 

The  state  transition  matrices  are  obtained  by  backward 


integration  of 


# 

$*X  = fx  $XX  + ^ $xx  5 (’4,'tf)  - I 

* 

§x\ 1 f*  $w  +-Pa#w  » $x\(tt,tf)=  0 

$AX“  9x$XX  4 Qxllxx  f $Xk('4»'h)~  0 

Stt'Skfe*  + 9\§xx  5 i>xx(t4,tf)-  I 


(180) 

(181) 

(182) 

(183) 


from  tf  to  tk,  and  Eq.  (179)  Is  used  to  generate  the  cor- 


rection to  the  costate  vector. 


Implementation  of  the  Control  Law 

To  use  this  pseudo-olosed  loop  control  law,  a player, 
say  the  pursuer,  initially  plays  his  open  loop  controls  for 
a short  time,  while  simultaneously  integrating  the  system 
state  and  costate  equations,  and  the  necessary  equations  to 
generate  the  control  matrix,  backward  from  final  time.  At 
Each  sampling  time,  t^,  the  pursuer  compares  the  actual 
state  of  the  system  with  the  reference  trajectory.  Any 
non-optimal  play  by  the  evader  will  be  manifested  as  a 
deviation  in  the  states.  The  pursuer  then  updates  the 
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costate  vector  by  Eq.  (151).  Using  the  updated  costate 
vector,  the  pursuer  again  plays  the  updated  open  loop  control 
until  the  next  sampling  time.  Mow  it  is  necessary  for  the 
pursuer  to  Integrate  the  states  and  updated  costates  forward 
until  the  stopping  condition  is  reached  to  predict  the  final 
conditions  for  the  new  trajectory.  Since  the  solution  is 
only  updated  to  first  order,  the  transversality  conditions 
are  not,  in  general,  satisfied  at  the  final  time.  Thus,  the 
final  values  of  the  costates  must  be  adjusted  to  meet  the 
transversality  conditions.  Using  these  new  terminal  conditions 
a new  reference  trajectory  and  control  matrix  are  generated 
by  backward  Integration,  as  before.  The  problem  ends  when 
the  range  rate  is  zero.  Figure  6 presents  a simplified  flow 
diagram  for  the  control  law. 


Linearized  TP3VP  Coefficients  and  Terminal  Conditions 


The  coefficients  for  the  linearized  state  and  costate 
equations,  Eqs.  (153)  and  (154) , are  presented  in  Appendix  A 
The  expressions  for  the  terminal  conditions  given  by 
Eqs.  (1?0)  and  (172)  are  given  in  Appendix  B. 


V.  Results 


The  test  cases  presented  In  this  report  were  numerically 
simulated  on  a CDC  6600  computer  using  a predictor-corrector 
integration  scheme.  Three  coplanar  trajectories  and  two 
non-ooplanar  trajectories  were  investigated.  The  trajec- 
tories used  different  vehicle  characteristics  and  varying 
final  ranges  as  indicated  in  Table  I.  In  all  oases,  the 
predicted  trajectory  was  integrated  forward  until  the  stop- 
ping condition  was  reached,  and  the  costates  were  adjusted 
to  satisfy  the  transversality  conditions  prior  to  integrating 
the  reference  trajectory. 

Coplanar  Model 

A sampling  interval  of  0.012  TU  was  arbitrarily  chosen 
to  test  the  control  laws  for  the  coplanar  trajectories. 

This  nominally  provided  l6  updates  along  the  trajectory. 

Both  the  backward  sweep  method  and  the  transition  matrix 
method  effectively  reduced  the  final  range  to  a value  less 
than  the  nominal  final  range,  except  for  the  case  where  the 
evader  used  the  control  V = 1.0.  This  result  was  not  too 
surprising  since  this  was  very  near  the  evader's  optimal 
control.  When  the  sampling  interval  was  decreased  to 
0.008  TU,  with  V - 1.0,  the  control  law  was  able  to  achieve 
a final  range  less  than  the  nominal. 

Both  the  backward  sweep  method  and  the  transition 
matrix  method  produced  similar,  though  not  identical,  results 
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when  tested  on  Trajectory  1.  Differences  can  best  be 
attributed  to  the  additional  numerical  operations  associ- 
ated with  the  transition  matrix  method. 

To  reduce  the  computation  time,  the  integration  step 
size  for  the  transition  matrix  method  was  initially  double 
that  of  the  backward  sweep  method.  It  was  found  that  the 
control  matrix  so  produced  was  not  symmetric  (as  it  should 
be  if  the  two  methods  were  indeed  equivalent),  the  elements 
were  not  close  to  those  of  the  S matrix  generated  by  the 
backward  sweep  method,  and  the  transition  matrix  method  did 
not  perform  nearly  as  well  as  the  backward  sweep  method. 

When  the  integration  step  size  was  made  identical  to  that  of 
the  backward  sweep  method,  the  final  results  improved,  the 
control  matrix  became  symmetrical,  generally,  to  five  sig- 
nificant figures  (usually,  to  six  significant  figures),  and 
the  elements  agreed  well  with  the  elements  of  the  S matrix. 

Since  decreasing  the  sampling  interval  to  0.008  TU 
improved  the  final  range  for  V = 1.0,  it  was  decided  to 
increase  the  sampling  Interval  to  0.016  TU  to  see  how 
badly  the  method  suffered  from  the  use  of  fewer  updates. 

(This  would  nominally  provide  12  updates.)  Again,  the 
control  law  was  able  to  decrease  the  final  range  below 
the  nominal  except  in  the  case  where  V = 1.0.  The  surprising 
results  were  that  in  two  cases,  V = 3»0  and  V = -3«0*  the 
final  range  was  less  than  for  the  smaller  sampling  interval. 
This  is  possibly  a result  of  the  way  in  which  the  control 
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law  works.  That  Is,  the  first  order  correction  at  the  long- 
er sampling  interval  may  have  combined  in  such  a way  as  to 
create  chese  anomolies  in  the  final  range. 

The  final  ranges  achieved  for  all  the  coplanar  tra- 
jectories are  summarized  in  Table  II.  Plots  of  all  the 
coplanar  trajectories  are  presented  in  Appendices  G thru  E. 
Each  plot  compares  the  TPBVP  solution  with  that  produced  by 
the  control  law.  A range  trace  for  the  final  portion  of 
each  trajectory  is  also  shown. 

Three  Dimensional  Model 

Because  of  the  larger  state  dimension,  along  with  the 
geometric  Increase  in  the  number  of  S matrix  differential 
equations,  the  sampling  interval  was  increased  to  0.024  TO 
to  test  the  control  law  for  the  three  dimensional  model. 

The  transition  matrix  method  was  not  tested. 

Since  Trajectory  4 was  the  same  as  Trajectory  1 except 
that  both  players  were  allowed  to  thrust  out  of  the  ref- 
erence plane,  a test  case  was  initially  run  to  validate 
the  three  dimensional  control  law.  The  evader's  controls 
were  set  at  7^  = 1.571 , lr2  = 0.0  so  that  the  evader  would 
remain  in  the  reference  plane.  (This  corresponds  to  the 
ooplanar  case  for  Trajectory  1 with  the  control  V = 0.0.) 

The  resulting  final  range  was  slightly  larger  than  that 
achieved  for  the  coplanar  case  with  a sampling  interval  of 
0.016  TU,  as  could  be  expected.  More  significant  was  the 
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TABLE  II.  PINAL  RANGE  POR  NON-OPTIMAL  EVADER  (COPLANAR) 
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result  that  the  control  law  did  not  erroneously  drive  the 
pursuer  out  of  the  reference  plane. 

In  all  cases  but  two,  the  control  law  decreased  the 
final  range  below  the  nominal  final  range.  The  two  ex- 
ceptions were  for  = 0.0,  V2  = 1.0;  and  for  = 1.571 » 

V2  = 1.0.  As  before,  this  was  not  too  disturbing,  as  the 
evader's  optimal  controls  were  in  this  quadrant.  A decrease 
of  the  sampling  interval  to  0.016  TU  was  sufficient  to 
obtain  a favorable  result  for  the  latter  case.  However, 
for  = 0.0,  V2  = 1.0,  the  sampling  interval  had  to  be 
decreased  to  0.012  TU  to  obtain  improvement  on  the  final 
range . 


Table  III  summarizes  the  final  ranges  achieved  for  the 
non-coplanar  trajectories.  Plots  of  the  non-coplanar 
trajectories  are  presented  in  Appendices  P and  G.  The 
nominal  trajectories  are  presented  in  each  case  for  com- 
parison, and  the  range  trace  for  the  last  portion  of  each 
trajectory  is  also  given. 


General  Comments 

Real  Time  Considerations . To  be  of  practical  use, 
this  control  law  must  be  capable  of  being  implemented  in 
real  time.  This  can  be  a formidable  task  for  realistic 
problems  with  large  state  dimension.  Both  methods  tested 
require  the  forward  Integration  of  2n  differential  equations 
for  the  trajectory  prediction.  In  addition,  the  transition 
matrix  method  requires  che  backward  integration  of  2n(2n+l) 
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equations  to  generate  the  reference  trajectory,  while  the 
backward  sweep  method  requires  n(n+2)  equations  to  be 
integrated.  The  computational  burden  of  the  backward  sweep 
method  can  be  reduced  to  ^n(n+5)  differential  equations 
by  taking  advantage  of  the  symmetry  of  the  S matrix.  This 
is  a significant  reduction  for  large  state  dimension  prob- 
lems . 


For  the  coplanar  model  considered  in  this  report, 
the  transition  matrix  method  required  Integrating  272 
equations  to  generate  the  reference  trajectory,  and  the 


backward  sweep  method  required  60  equations.  This  latter 
number  could  have  been  reduced  to  52  equations.  For  the 
non-coplanar  model,  168  equations  were  Integrated  to 
generate  the  reference  trajectory.  This  could  have  been 
reduced  by  almost  hot  to  102  equations.  The  transition 
matrix  method  would  require  the  Integration  of  600  equations! 

Using  a sampling  interval  of  0.012  TU,  the  backward 
sweep  method  required  a maximum  computation  time  of  12.2 
seconds  to  compute  a reference  trajectory  for  the  coplanar 
model,  and  the  transition  matrix  method  required  24.2  sec- 
onds. This  is  not  real  time,  as  0.012  TU  corresponds  to 
approximately  9.7  seconds.  For  the  non-coplanar  model, 
with  a sampling  interval  of  0.024  TU  (19*36  seconds),  the 
maximum  computation  time  was  32.03  seconds.  By  reducing 
the  number  of  equations  to  be  Integrated  for  the  3 matrix, 
both  of  the  backward  sweep  models  could  be  performed  very 
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olose  to  real  time  for  the  specified  sampling  interval.  1 

Stability  of  the  Backward  Sweep  Method.  While  the  fj 

\] 

baokward  sweep  method  enjoys  the  advantage  of  the  lesser  hi 

i 

computational  burden,  the  S matrix  sometimes  becomes  in-  | 

finite  during  the  backward  integration  of  the  matrix  Riccati  \ 

equation,  Eq.  (169).  For  the  problems  considered  in  this  } 

U, 

i 

report,  the  S’  matrix  originally  became  unbounded  during  the  \ 

backward  integration.  This  problem  was  resolved  by  de- 
creasing the  integration  step  size  to  one-half  its  original  2 

value,  to  0.0005  TU.  However,  using  this  new  integration  ; 

step  size,  the  backward  sweep  method  failed  on  Trajectory  3»  j 

7 

Predicted  Range  at  Each  Update  Time.  Tables  IV  thru 
XIII  present  the  predicted  final  range  at  each  update  time, 

J 

based  on  optimal  play  by  both  players  from  the  update  time 
to  final  time.  The  predicted  range  did  not,  in  general,  : 

monotonically  decrease  at  each  successive  update  on  a given 
trajectory.  Only  in  those  cases  where  the  evader's  control 
was  near-optimal  did  the  predicted  range  display  a monotonic 
decrease.  This  phenomenon  is  apparantly  a result  of  non- 
unique solutions  which  result  when  the  evader  behaves  in  such 
a way  that  the  pursuer  has  sufficient  control  to  drive  the 
range  to  near-zero. 


IV.  PREDICTED  PINAL  RANGE  AT  EACH  SAMPLING  TIME 

Trajectory  1,  Transition  Matrix  Method, 
Sampling  Interval  =*  0.012  TU 

(Entries  rounded  to  two  decimal  places) 


Stapling 


Predicted  Pinal  Bange  (NK) 


Evader* s Control  (Radians) 


0.012 

3.57 

7.39 

8.53 

6.29 

2.53 

2.15 

2.68 

.024 

0.79 

6.50 

8.97 

4.37 

2.10 

4.03 

2.16 

.036 

0.68 

5.32 

8.73 

2.35 

0.68 

4.50 

0.90 

.048 

2.64 

4.50 

8.74 

0.69 

0.70 

4.44 

1.49 

.060 

1.43 

3.52 

8.69 

0.70 

0.59 

4.38 

0.54 

.0?2 

1.89 

2.62 

8.69 

0.77 

4.62 

4.72 

1.88 

.084 

0.56 

2.43 

8.70 

0.95 

3.59 

4.71 

1.95 

.09  6 

1.61 

2.03 

8.70 

1.58 

2.49 

5.03 

lo6l 

.108 

1.52 

1.40 

8.70 

1.69 

2.21 

4.95 

1.47 

• 120 

1.33 

2.14 

8.70 

1.68 

2.34 

4.90 

1.61 

*132 

1=3? 

2 5 1? 

fl.70 
» 1 » 

1.68 

n qA 

< -*1 

0.48 

.144 

1.84 

2.02 

8.70 

1.68 

1.20 

5.21 

1.07 

.156 

0.77 

2.19 

8.70 

1.68 

1.03 

5.12 

1.44 

.168 

0*30 

2.62 

8.70 

1.68 

1.36 

5.08 

1.22 

.180 

0.15 

1.89 

8.40 

1.68 

1.35 

5c07 

1.41 

.192 

0.72 

1.73 

8.39 

1.68 

1.34 

5.06 

0.57 

•204 

0.19 

2.59 
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TABLE  V,  PREDICTED  PINAL  RANGE  AT  EACH  SAMPLING  TIME 

Trajectory  1,  Backward.  Sweep  Method, 

Sampling  Interval  » 0=012  TU 

(Entries  rounded  to  two  deoimal  places) 


Sampling 

Time 


0.012 
.024 
.036 
.048 
•060 
.072 
.034 
.096 
.108 
• 120 
.132 


Predicted  Pinal  Range  (NM) 
Evader's  Control  (Radians) 

3.0  2.0  1.0  0.0  -1.0  -2.0 

3.57  7.38  8.53  6.29  2.53  0.64 
0.79  6.50  8.97  4.37  2.10  4.07 
0.68  5.32  8.72  2.35  0.68  4.03 
2.64  4.50  8.73  0.69  0.70  4.04 
1.43  3.52  8.69  0.70  0.59  4.35 
1.89  2.62  8.69  0.77  4.02  4.32 
0.56  2.43  8.70  0.95  2.59  4.25 
1.61  2.03  8.70  T758  2.6l  4.63 

1.52  1.40  8.70  1.69  1.79  4.52 
1.33  2.14  8.45  1.68  1.80  4.48 
1,3?  1 = 09  8^44  1.68  1.80  4.89 


-3.0 

2.68 

2.16 
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1.49 
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1.88 
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.144 

0.27 

2.02 

8.39 

1.68 

1.80 

4.79 

1.38 

.156 

0.77 

1.29 

8.36 

1.68 

1.80 

4.70 

1.51 

.168 

0 .64 

1.74 

8.35 

1.68 

1.80 

4.67 

1.27 

.180 

0.50 

1.19 

8.34 

1.68 

1.80 

4.66 

1.50 

.192 

1.10 

1.97 

8.33 

1.68 

1.80 

4.65 
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TABLE  VI.  PREDICTED  FINAL  RANGE  AT  EACH  SAMPLING  TIME 

Trajectory  1,  Backward  Sweep  Method, 

Sampling  Interval  * 0.016  TU 

(Entries  rounded  to  two  decimal  places) 


0.016 

.032 

.048 

.064 

.080 

.096 

.112 

.128 

.144 


Predicted  Final  Bange  (NM) 

Evader’s  Control  (Radians) 

3.0  2.0  1.0  0.0  -1.0  -2.0  -3. 

2.26  6.95  8.61  5.81  1.53  2.40  1.76 

1.99  5.91  9.04  3.56  3.01  4.94  3.31 

1.14  4.75  8.85  1.52  1.46  4.97  2.10 

3.75  3.19  8.81  1.60  1.73  5.16  1.61 

0.83  2.47  8.78  1.70  1.88  5.15  1.74 

1.63  2.12  8.80  1.73  2.40  5.13  1.47 

2.40  1.39  8.56  1.72  2.31  5.36  0.63 

0.96  1.96  8.53  1.72  1.27  5.29  2.15 


0.53 

0.90 


A l«  A 

V 


1.52  8.47  1.72  1.29  5.22  0.60 

1.43  8.45  1.72  1.37  5.24  1.11 

. eh.  Q IlIl  1 no  a . «.  S.Kb  n .67 

— • f w ' - - ■ » 


0.46  1.07  8.43  1.72  0 .66  5.52  0 .89 
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BLE  VII.  PREDICTED  PINAL  RANGE  AT  EACH  SAMPLING  TIME 

Trajeotory  1,  Backward  Sweep  Method, 

V * 1.0,  Sampling  Interval  * 0.008  TU 

(Entries  rounded  to  two.  decimal  places) 


Sampling 

Time 

Pinal 

Range 

Sampling 

Time 

Pinal 

Range 

Sampling  Pinal 
Time  Range 

0.008 

8.46 

0.072 

8.57 

0.136 

8.32 

.016 

8.61 

.080 

8.57 

.144 

8.28 

.024 

8.59 

.088 

8.57 

.152 

8.25 

CM 

O 

O 

. 

8.57 

.096 

8.57 

.160 

8.23 

o 

•3- 

o 

• 

8.57 

.104 

8.57 

.168 

8.22 

.048 

8.57 

.112 

8.57 

.176 

8.21 

.056 

8.57 

.120 

8.57 

.184 

8.20 

.064 

8.57 

.128 

8.33 

.192 

8.20 

TABLE  VIII*  PREDICTED  PINAL  RANGE  AT  EACH  SAMPLING  TIME 

Trajectory  2,  Backward  Sweep  Method, 

Stapling  Interval  * 0.012  TU 

(Entries  rounded  to  two  decimal  places) 

I Predicted  Pinal  Range  (NM) 


Time 

Evader* s Control  l 

Radians) 

3.0 

KEUEB 

ESI 

| 

0.012 

18.11 

23.37 

25.03 

21.70 

16.46 

13.96 

.024 

14.02 

23.48 

24.97 

20.52 

10.33 

3.26 

.036 

7.56 

21.84 

24.84 

17.38 

2.48 

6.92 

.048 

1.89 

20.39 

24.75 

14.38 

4.72 

7.07 

.060 

4.64 

19.07 

24.68 

11.72 

3.25 

7.06 

tv 

o- 

o 

• 

1.19 

17.74 

24.52 

8.97 

1.21 

7.02 

.084 

1.79 

16.64 

24.42 

6.66 

1.14 

7.24 

.096 

3.71 

15.51 

24.36 

4.61 

0.73 

7.16 

.108 

1.79 

14.53 

24.19 

2.73 

4.39 

7.13 

.120 

2.24 

13.65 

24.10 

1.03 

3.80 

7.34 

1 

1 . O'X 
— • — ^ 

1 9 aa 

9k  09 

n LR 
~ 

0 OK 

"*•  i y 

7*26 

.144 

1.31 

12.21 

23.97 

0.97 

2.63 

7.21 

.156 

0.36 

11.68 

23.82 

■1.23 

2.66 

7.21 

.168 

0.36 

11.32 

23.76 

1.92 

2.68 

7.44 

.180 

1.03 

10.88 

23.72 

1.91 

2.68 

7.39 

.192 

1.63 

10.66 

23.70 

7.36 

•sf 

o 

CM 

. 

0.46 

10.67 

■ 

ESI 

gg 

3.88 


2.08 


3.58 
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TA»T-*  IX.  PREDICTED  PINAL  RANGE  AT  EACH  SAMPLING  TIME 

Trajectory  3»  Transition  Matrix  Method, 

Sampling  Interval  * 0.012  TU 

(Entries  rounded  to  two  decimal  places) 


Predicted  Pinal  Range  (NM) 

Sampling  ‘ 

Tine  Evader's  Control  (Radians) 


.204 


.216 


.228 


I 

3.0 

B9 

BBS 

— 

BBI 

-2.0 

-3.0 

wrnrn 

16.57 

22.90 

25.00 

20.89 

14.62 

11.58 

14.85 

.024 

7.93 

20.81 

24.82 

16.72 

4.09 

3.30 

4.42 

.036 

0.93 

18.77 

24.75 

12.67 

5.57 

2.60 

5.44 

.048 

1.29 

16.81 

24.57 

8.87 

2.75 

4.10 

2.35 

.060 

2.12 

15.07 

24.46 

5.23 

0.98 

4.44 

2.00 

.072 

5.11 

13.23 

24.27 

1.81 

1.00 

4.25 

7M 

.084 

0.57 

11.47 

24.15 

0.64 

1.03 

5.03 

4.37 

.09  6 

0.84 

9.83 

23.94 

4.06 

0,99 

4.8  7 

2.40 

.108 

3.24 

8.44 

23.81 

0.82 

1.20 

5.16 

0.57 

.120 

4.84 

6.72 

23.60 

1.47 

2.27 

5.41 

3.06 

.132 

0.38 

5.60 

23.46 

4.4? 

1.94 

5.70 

0.84 

.144 

1.78 

4.49 

23.26 

2.35 

1.32 

5.45 

3.27 

.15* 

5.02 

3.33 

23.13 

2.38 

2.30 

5.72 

0.57 

.168 

1.68 

2.55 

23.04 

2.39 

2.08 

6.04 

2.0  5 

.180 

1.91 

2.60 

22.99 

2.39 

2.27 

5.83 

0.93 

.192 

2.70 

1.72 

22.96 

ES9 

BBI 

5.77 

3.00 

1.50 

1.51 


1.22 

0.63 


TABLE  X.  PREDICTED  FINAL  RANGE  AT  EACH  SAMPLING  TIMS 

Trajectory  4,  Backward  Sweep  Method, 

Sampling  Interval  * 0.024  TU 

(Entries  rounded  to  two  decimal  places) 

Predicted  Final  Bange  (NM) 

Evader's  Control  (Radians) 


Sampling 

Time 


0.024 

8.30 

CO 

-tf- 

o 

. 

8.74 

.072 

8.27 

.096 

8.35 

.120 

8.04 

.144 

8.08 

.168 

7.95 

.192 

7.92 

« 0.0 

1.0  V2  = 


1.571 


3.14 


6.70 


7.19 


6.71 


6.63 


6.66 


6.68 


6.67 


4.21 


1.67 


1.56 


5.45 


2.47 


1.69 


0.50 


8.30 

6.70 

8.75 

7.18 

8.28 

6.99 

8.36 

6.71 

8.05 

6.63 

8.09 

'6.65 

7.96 

6.67 

7.93 

6.67 

TJALB  XI*  PREDICTED  PINAL  RANGE  AT  EACH  SAMPLING  TIME 
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192  | 18.78  15.01  20,22  | 10.78  5.57  7.66 


TABLE  XII.  PBEDICTED  FINAL  BANGE  AT  EACH  SAMPLING  TIME 


Trajectory  5*  Backward.  Sweep  Method,  Vi  * 0,0, 
73  * 1*0,  Sampling  Interval  * 0.012  TU 

(Entries  rounded  to  two  decimal  places) 


Sampling 

Final 

Sampling 

Final 

Time 

Range 

Time 

Bange 

0.012 

16.14 

0.108 

16.75 

.024 

18. SI 

.120 

16.63 

.036 

18.51 

.132 

16.44 

00 

■4- 

O 

• 

18.18 

.144 

16.32 

.060 

17.75 

.156 

16.30 

. 

O 

-C 

t\> 

17.48 

.168 

16.20 

.084 

17.19 

.180 

16.13 

.096 

16.98 

.192 

16.10  ! 

TABLE  XIII.  PBEDICTED  FINAL  BANGE  AT  EACH  SAMPLING  TIME 

Trajectory  5,  Baokward  Sweep  Method,  V*  = 1.571* 

Vg  * 1.0,  Sampling  Interval  = 0.016  TU 


(Entries  rounded  to  two  decimal  places) 


Sampling 

Time 


Final  I Sampling 
Bauge  I Time 


Final 

Bangs 


0s0l6 

.032 

.048 

.064 

•080 

.096 


15-53 

15.94 

15.66 

15.52 

15.23 

15.20 


n 119 

.128 

.144 

.160 

.176 

.192 


15.13 


15.09 


15.07 


15.05 


14.8? 


14.86 


I 
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VI . Conclusions 


The  control  law  proposed  by  Anderson  has  been  applied 
to  a free  time,  minimax  final  range  pursuit-evasion  game 
between  two  spacecraft.  The  coplanar  encounter  was  ex- 
tensively investigated  using  the  backward  sweep  method  and 
the  transition  matrix  method.  The  backward  sweep  method 
was  also  applied  to  the  three  dimensional  intercept  problem. 

The  control  law  has  effectively  demonstrated  its 
ability  to  guide  the  pursuer  to  a better  solution  when  the 
evader  is  behaving  non-opcimally . The  shorter  sampling 
Interval,  in  general,  provided  a creater  improvement  on  the 


final  range 


:n 


In  addition,  the  two  methods  proposed  to  im- 


1 


i 


pleraent  the  control  law  have  been  shown  to  produce  equivalent 
results. 

Another  significant  conclusion  from  this  investigation 
which  must  not  go  unmentioned,  is  that  the  control  law  dis- 
played remarkable  flexibility  in  the  problems  considered. 

The  basic  logic  displayed  in  Fig.  6 was  used  in  ail  computer 
programs  used  to  simulate  the  control  law.  The  basic  program 
used  for  the  backward  sweep  method  was  only  altered  to 
accomodate  differences  peculiar  to  the  transition  matrix 
method,  and  in  the  three  dimensional  case,  to  accomodate 
the  larger  state  dimension.  These  programs  were  used, 
unaltered,  to  test  all  cases  presented  in  this  report.  No 
"fine  tuning H of  any  kind  was  necessary  to  adapt  the  programs 
to  each  particular  case. 
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The  problem  of  real  time  computation  is  not  considered 
an  insurmountable  problem  in  the  implementation  of  this 
control  law.  Special  use  computers,  along  with  parallel 
processing  could  provide  rapid  update  solutions.  In  an 
actual  encounter,  the  costate  vector  should  be  updated  as 
often  as  eaoh  new  reference  trajectory  becomes  available. 
This  should  provide  better  results  than  those  achieved  with 
the  fixed  update  times  used  in  this  report. 


One  disadvantage  of  this  control  law  which  this 
report  has  not  considered,  is  that  a reference  TEByP 


solution  is  required  prior  to  starting  the  procedi 


/; 

The 


TPBVP  solutions  used  for  this  report  were  generated  using 
a general  purpose  algorithm  developed  by  M.  J.  D.  Powell 
(Ref.  6). 
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Appendix  A 

Coefficients  for  the  Linearized  TPBVP 


The  linearized  state  and  oostate  differential  equations 
may  be  written 

s‘x  - 8x  f\  8 X 
8X*  9*8*  + g*8X 

Since  the  state  and  costate  equations  are  separable,  the 
n x n coefficient  matrices  fx,  f^  , gx,  and  gx  may  be  par- 


titloned  as 

follows; 

fit  = 

: 0 

fx* 

rr  i 

tap  ; 

0 

_0 

If* 

.0] 

f«J 

9*= 

9xp 

9x= 

9xp  i 

o1 

6 

|9*e_ 

.0  | 

gxe 

where  the  elements  of  the  sub-matrices  are 
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\ 

) 


i 


i 


41  - - 

•XpM.  Xip 

r - 2. <4fftp  a.  Cp  XfcpeosXap  / ^ ^(*fT  \ 

TXptf  ~ X»p4m*-X3p  tyyt  %tM*fcp  ^ ^ ~ t>f  *w*Xip/ 

r s ~ 2-Xfrp  cot>Xap 

'"PM-  X»p6^Xip 

-fxp4<,=  ~xTf  (XaP  * ZX^cotXap) 


W V1  (#  - l) 

r - Cp  AipW  _ r 
•Ap24  Op’/*-  " *0^ 

P r £p  _ r 

T^pit  Op^t  si^Xjp  ” * ApC.1 

£ - ~£p~  ( A»p  i\ 

TAPX4  Dp'/*-  \ Dp  - I) 

f - Cp  Aa^p  _ r 
*>P4t  Ey,xt«,mxXv  " Up44 


r r — 

rApa  VlSlMl% 


JaL-  - \] 

&p  ^m*’)lip  I / 


9*p»  * - b [V  (4 + >*  ‘^<5p  - i)  - V(>w*v>  - ’Saf  a?) 

<“Awf(x*pX<*p  + 2x4pXtp  cotx^p)  A*>r^pJ 

9xpi*-~  "xij'*’  (Vw  * Afrp  x^) 

9*prt  = xp?*  ( AapXj?  *'* 2x»?  + A*  Xi cos2Xip  t - ) 

9xpi4  * )(!*  (^-AzpX^”  A^pXap  - 2Awp Xi^ «“t  <3p  4-  A?p) 


6o 


9 ~ 


-CT 

+xf 


where 


DP-  + fef 


The  non-zero  ooeffioients  for  the  evader  are 


-fxeiT- = 


r - X&SivaXif  , £e  X-ze  tie  co^Xje 

Uez*>~  x»«.  * D***  WXae 

f - x/\4< 

TyeM  x>e 

fye^T  Ti  (2  X‘><'Sl*'1X3e) 

fl(Ml  ’ - 
•fx«34 = HTc 

f*B4i  = -k1  ~ xA*aI*as] 
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■fxefci = (Xie  X4c  +•  2 X*«  foe  cot  X^e)  I 

r j 

TXeCl”  X,e  3 

r , r Xfcfi  _ Cc  X(,e  cosXtg  _ >\u  \ i 

TXetB  XteSw^Xw  DeVl  s\n*X*e  [*~  be  si nlK:$e./  | 

ft«U=  xi  (z  Xw  <^t  foe)  ] 

“fiteU  c “ Ifce  ( *z€  + 2 X^e  cot  X?e ) j 


r _ _ Ce  A^eA^e  _ P 

<5\*2X*e  ~ tx*U 


f Ae«T  " De1*  ^>mlXie 


Awe  _ 


gxeu  = ~ (*“  + *“ Sl,?)!3e  ' ‘xTe)  + V 

- X«e  (wX4e  - ***&)  + X«  Xte 

- Aw>e  (foe  Xfc©  + 2 X4€  Xwe  co±  X^e) 

^ Awe  Xw&) 

9xeiS  - ~X  | X-ze  Xwe  *bm  2Xae  + Aac  Xte  cos2Xje 

» ^ Aug.  XAe  Xue\ 

*v«  ^X^e.  / 

9xci4-=  x||  ( 2A*e  X4e  + - \4eXxe  - 2.  Awe  Xwe  c-°"^  Ase) 

9xc  u,  r [2  Xze  Xwe  si^Xae  + Aac  Xwe  w'Zht  v 
~ Awe  (Xz«  +■  2 Xac  C-ot  X3&)] 

9xei\=  gxea 

9»*=  -& 

9“*= 

9xC3^  = 9xe>3 

9x&33=  ccs2X3e  + A4eX&sm2x*>  + 2 


Appendix  B 

Terminal  Conditions  for  the  Control  Lars 
The  terminal  conditon  given  by 

[0n  - -T2.  'iZx-^-x 

must  be  evaluated  at  final  time  prior  to  the  backward 
integration  for  both  control  laws. 

Coplanar  Model 

The  non-zero  elements  of  the  0xx  matrix  are 
0xxn  = I 

0Wl5r  ~ B^“ 

0xx*3=  (XipXie  B)^ 

0W.35"'  (X»pA//f|  = 0X)C53 

Ax37"  “(XlpXui  B)Ti  - 0KK73 

I 

$%y&5~  I 

$XX57=  — (X*p  A)f£  “ 0XX75 
0W77“  (XipXie  B)Tf 
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, ^ ^.,.4Ur--  >wew^y~3n,r?  v,^7^55/w^m^ 


-5  >71M5J 


where 


12  x»  - (Xip  “ XieB  - X^eh)  ^ 

XiXx  - (X»f-  XteB)^ 

12.  X3  = [(XipXie  + XtpXie)  A +■  (x4pX\e~  Xip^ejBj^. 

-^-X+  ” (X»e  A)  /fj 

12.  x5  = (X2£-XipB+  X^pA)^ 

Hfl.  z (Xt€  - X|f  p)  ^ 

12. Xf  r £■  (XxpXie  + XtpXze)  A - (x^p  Xie-  XipXAc) 

-&X8  ~ "(XlP  A)  <4. 


A “ Sin  (X^p  ~ X^e) 

5 ^ cos  ( Xap  ~ X^fi, 


a 


i 


A - tea.  + sa  v\  - ( o -p] 

^1>  \3T  ax  /Tf  ~ l-^xT/'ty 


(This  scalar  product  was  performed  by  matrix  multiplication 
within  the  computer  program.) 


6? 


I *-■-» m.v-j.vjaaM'1  Mia  f nlTit 


Three  Dimensional  Model 

The  non-zero  elements  of  the  0XX  matrix  are 

$X*U  r | 

0»w=  “[X»e(a-SB*CC-5^*CB)]^  = <*W 
0kx i«> = (X»e  SA*  SB*  SC)^  = <&k% si 
Axn  *“  (~  ^A*  4 cc  - Ck  • CB)Tf  « 0oni 

<2Wi9=  “[X>e(SA.  CB-CC  - CA*SB^  * f*x*9i 

&x»,ir  “(Xie  SA*  SB*  SC)T+  * 0y«,»,v 
A«3  r [XipXtef^A*  SB-  CC  + Ck  * CbJ^ 

0xx55r  (Xip  Xie  CV  SB*  2>c)^  0xks3 
fW  HXip  (^A*SB*  CC  - SA*  CbE^  - 0xm 

$«39~  "[XtpXie  (cA-  C&*  CC  + SA-  SBj]^  = 0kx93 
(Aqc3<i»~  "Mie  CA*S8*SC)T|  - 0xjuij3 
0xx55"  (Xip  Xi«.  SA*SB*Cc)^ 

06*xS7  = (ftp  SA  • SB  • Sc)T,  - 0xx-(5 

$oo59  = (Xip X»e  $A‘C6*Sc)^  * 0X'X95 
ftois.ir  ~(x>pX»e  SA-£B*£C)Tj  » 0xx»i,s 
0XX7.7”  I 

0*X7f»r  ~[Xip  (SA-CB*  CC  - CA-SBj]^  - 0x*$7 
0KX7,ir  ~(X>P  Sc)T4-  0XXM.T 
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$W  = [XiPXie($&’SB-CC  +CA'CB)^ 

~(VlpVte  &Ar  CB’ $C)>^  “ 0)0(11,9 

0xx»,»\=  (Xip  Vie  ‘oA,* ^>B  ^CCj-^ 


Ax,  = [X*P  ~ X2e(sA-SB*CC  + CA-Cb) 

- X4e(s>A*CB*CC  “ CA*  SB)  - X*  CVSB-Sc]^ 
£L*z  s[Vip  “ Xls>(sA-SB-CC  + CA-CbIL 

r (ffVjeXzp  + XtpX2e)(cA-  SB*  CC  - SA*  cb) 

+ X4f  Xie  (SA-  SB*  CC  •+  CA-Cb) 

- Xip  X4€  (cA-  CB  ' CC  + SA-  SB) 

+•  (X(pf  Xt€  - XipXte)(  CA-SS-Sc)]^ 

£L*a  " “jx»e  (C-A*  SB-CC  - SA-  CB^ 

-^•XS  = [(XlC  Xzpt  XipXze)  BA- SB -SC 


4XwX.-  ^A.c.r.c,/'  j.  y._  y.. 

’■’T  **»*»  ^ ^ W *M|/  rvt^; 

+(XtpX,e  - XipXte)  SA*  SB*  CC]* 


4.  Y. _ Y . . c A z' n C'* 
-'>K  r'*t«i  *Jn'  ^o* 


= (Vie  SV  SB'  SC)f4 

-T2-X7  ~ [X^ Xip  (SA*  SB- CC  + CA*  Cb) 

-X*p  ( CA * SB-CC  - SA’Cb)  + Xw*  SA-Sg-Sc] 

= [Xie  " X,p  (SA*  SB  • CC  + CA-Cb}]^ 
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'v  - ’’i • "”C"T  T— 


■ .•4*v.***»  ^1 


U-M  =f^XiftXip  + X|pXxe)(<A'CB*  CC  - CA*  SB) 

“ <UpX»e  (cA*  CB*  CC  +•  SA»Sb) 

+X,pX4*(SA*  SB  • CC  +CA‘Cb) 

+ (V4pX»c~  X|pX^e)  SA*  CB»*  SC]^ 

XL% l0=  [-Xi?(sA*CB-  CC  — cK-'Sfe)]^ 

_CLx,j  r {r  (Xie  ^2-p  + XtpXxe)  SAt  • SB  • SC. 

- X4fXi*  CA.  SB*  SC  "XtpXfe  SA-CB-SC 

- (XfrpXie  - XtpXte)  SA*  SB*  CCJT^ 

-fr-xa-  “{Xip  SA-  SB  • 6c)/^. 

where 

S A - Sin  Xap 
CA  s (~0^>  X^p 
SB-  si  a Xse 

CB“  toS  X3€ 

SCs  Sin  (X«»p~  Xse) 

(X  - COS  (X5p-Xse) 

again, 

was  formed  by  matrix  multlplioation  within  the  ooaputer 
program. 


again. 
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Plots  of  Trajectory  1 
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Pig.  C-3.  Trajectory  1,  Backward  Sweep  Method 
V = 1.0,  Samel ing  Interval  = 0.008  TU. 
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V ■ 0.0,  Sampling  Interval  = 0.012  TO. 
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Pig.  C-5.  Trajectory  1,  Backward.  Sweep  Method 
7 3 -1.0,  Sampling  Interval  = 0.012  TU. 
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Pig.  C-9.  Trajectory  1,  Transition  Matrix  Method. 
V ■ 2.0,  Sampling  Interval  * 0,012  TU. 
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Fig.  C-10.  Trajectory  1,  Transition  Matrix  Method 
V » 1.0,  Sampling  Interval  » 0.012  TO. 
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Pig.  C-ll.  Trajeotory  1,  Transition  Matrix  Method. 
V * 0.0,  Sampling  Interval  « 0.012  TU. 
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Pig.  C-12.  Trajectory  1,  Transition  Matrix  Method 
V * -1.0,  Sampling  Interval  = 0.012  TU. 
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Pig,  C-13,  Trajectory  1,  Transition  Matrix  Method 
V ■ -2.0,  Stapling  Interval  » 0.012  TO. 
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RRQIUS  CD 


Pig.  C-l6.  Trajectory  1,  Backward  Sweep  Method 
V = 2.0,  Sampling  Interval  = 0.016  TU, 
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Fig.  C-l ?.  Trajectory  1,  Backward  Sweep  Method 
V » 1.0,  Sampling  Interval  = 0.016  T(J. 
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Fig,  C-19*  Trajectory  1,  Backward  Sweep  Method 
V * -1.0,  Sampling  Interval  ■ 0.016  TU. 


RRDIUS  ( 


Pig.  C-21.  Trajectory  1,  Baokward  Sweep  Method. 
V a -3.0,  Sampling  Interval  = 0.016  TU. 
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Pig.  D-l.  Trajeotory  2,  Backward  Sweep  Method. 
V * 3.0,  Sampling  Interval  = 0.012  TU. 
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Fig.  D-6.  Trajectory  2,  Baokward  Sweep  Method. 
V * -2.0,  Sampling  Interval  * 0.012  TO. 
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Pig.  E-2.  Trajectory  3,  Transition  Matrix  Method, 
V * 2.0,  Sampling  Interval  =*  0.012  TU. 
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Pig.  E-7.  Trajectory  3»  Transition  Matrix  Method. 
V * -3.0,  Sampling  Interval  * 0.012  TU. 
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Pig.  P-1. Trajectory  4,  Backward  Sweep  Method. 

» 0.0,  Vg  = 1.0,  Sampling  Interval  =*  0.024  TU. 
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*lg  F-3*  Trajectory  4,  Backward  Sweep  Method. 

Vi  * 3.14,  V,  » 1.0,  Sampling  Interval  * 0.024  TU 
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Pig.  P-4.  Trajectory  4,  Baokward  Sweep  Method. 

V.  * 3.14,  V9  = -1.0,  Sampling  Interval  * 0.024  TU 


IWNGe  (Ntt 


•Fig.  G-2.  Trajectory  5*  Backward  Sweep  Method, 

Vx  * 0.0,  V2  = -1.0,  Sampling  Interval  = 0.024  TU. 
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Pig.  G-3*  Trajectory  5,  Backward  Sweep  Method. 

V.  * 1.571*  V0  » 1.0,  Sampling  Interval  * 0.016  TO 


Pig.  G-8.  Trajectory  5*  Backward  Sweep  Method. 

» 4.7 1,  V.£  - -1.0,  Sampling  Interval  * 0.024  TU. 


123 


Vita 


attended  Kansas  State  University  where  he  earned  a Bachelor 
of  Science  degree  in  Electrical  Engineering.  Upon  graduation 
in  1967*  he  was  commissi  ;ned  through  the  USAF  BOTC  program 
and  was  assigned  to  USAP  Undergraduate  Pilot  Training. 
Following  completion  of  pilot  training,  he  served  as  a 
squadron  pilot  in  the  P-102  in  Germany;  as  a Forward  Air 
Controller  and  flight  instructor  in  the  0-2A  in  Southeast 
Asia;  as  flight  instructor  in  the  T-38;  and  as  a Wing 
Operations  Stf.ff  Officer.  In  June,  1974,  he  entered  the 
Graduate  Astronaut leal  Engineering  program  r t the  Air  Force 
Institute  of  Technology. 


124 


